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© Audio video interactive display. 



© A method and apparatus for synchronizing two 
independent rasters, such that a standard TV video 
and a high resolution computer generated graphics 
video may each be displayed on a high resolution 
graphics monitor. This is accomplished utilizing dual 
frame buffers. A TV frame buffer, comprises a dual 
port VRAM, with the serial and random ports operat- 
ing asynchronously. The primary port receives in- 
coming TV video synchronously as it comes in, and 
the secondary port reads the TV video out synchro- 
nously with the high resolution graphics monitor. A 
high resolution frame buffer in a computer is utilized 
to store high resolution graphics which is read out 



synchronously with the high resolution graphics 
monitor. A switching mechanism selects which of the 
TV video and the high resolution graphics video is to 
be displayed at a given time. The TV frame buffer 
includes an on screen and off screen portion. The 
computer provides computer data, including high 
resolution graphics data and audio data to the TV 
frame buffer, with the graphics data being stored in 
the on screen portion and the audio data being 
stored in the off screen portion. The audio data is 
read out to an audio circuit for replay. The graphics 
data is combined with the TV video for purposes of 
windowing. 
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Field of Invention 



The invention is in the field of display devices, 
and specifically is directed to an audio video inter- 
active display device in which two independent 
rasters are synchronized, such that a standard TV 
video and a high resolution computer generated 
graphics video may each be displayed in different 
combinations on a high resolution graphics monitor. 
Computer generated audio may be played in con- 
junction with the display on the high resolution 
graphics monitor. 

Background of The Invention 

One of the difficulties encountered when dis- 
playing motion video from a standard (e.g. NTSC) 
video source on a high-resolution graphics screen 
is that of synchronizing the two independent 
"rasters". There is no inherent relationship between 
the timing (synchronization) of the two independent 
sources. If one were to try to use a conventional 
memory architecture, it would be extremely difficult 
to synchronize the write operation, which is syn- 
chronous with the incoming video, with the read 
operation, which must be synchronous with the 
high-resolution display on which the video is ulti- 
mately presented. 

Another challenge is presented by the high 
speed with which the video information must be 
manipulated in order to achieve full-motion video 
performance. Attempting to do this with a conven- 
tional display controller design risks having inad- 
equate performance. 

Yet another challenge is presented by the fact 
that the manner in which television signals are 
displayed is fundamentally different from the meth- 
od used by most high-resolution displays. The in- 
herently interlaced characteristic of the incoming 
video in TV information must be eliminated in order 
to present it on the non-interlaced high-resolution 
graphics screen. Several possibilities exist for solv- 
ing this problem, each having relative advantages 
and disadvantages. 

Summary of The Invention 

According to the present invention, a 
workstation-based frame buffer is intended to add 
full-motion, full-color, video and medium-to-high 
quality stereo audio to a personal workstation envi- 
ronment. It supports the mixing of this motion video 
with the high-resolution graphics of the host com- 



puter, so that video "windows" can be placed on 
the high resolution screen. The source of video can 
be any standard video source, such as a video 
camera, an optical videodisc player, a VCR, etc. 

s Many video formats are supported, including, PAL, 
NTSC. SECAM, SVHS, etc. 

The audio section of the invention allows real 
time stereo audio playback and recording from the 
host. This audio processing is completely indepen- 

w dent of the video capture process thus allowing the 
user complete control over the audio portion of a 
multi-media application. For example, a user may 
select from one of several "soundtracks" to accom- 
pany a given video presentation. One application of 

t5 this feature could be the release of multi-iingual 
material, where the aucio/voice information is 
shipped in many languages, with the user selecting 
whichever language is preferred. 

There are three major ideas that are incor- 

20 porated into the approach taken to solve the tech- 
nical problems that are presented. The combination 
of these ideas yield a unique solution for smoothly 
integrating digital video and audio within a host 
workstation environment. 

25 

TIME BASE CORRECTION 

The problem of synchronizing the incoming TV 
30 video with the high-resolution graphics output from 
the host can be solved using the unique dual-port 
properties of VRAM technology. The secondary 
(serial) port of these special-purpose VRAMs can 
be operated completely asynchronously to the pri- 
35 mary (random) port. Hence, the primary port can 
be used to store incoming video information syn- 
chronously, as it comes in, while the secondary 
port can read the video data out of the frame buffer 
synchronously with the high-resolution graphics 
40 display. Thus, a form of time base correction can 
be achieved by appropriate use of the independent 
properties of the video RAM's two ports. 

45 DUAL FRAME BUFFER APPROACH 

There are several approaches to combining 
video with high resolution graphics. Some methods 
simply double the scan rate of the incoming video 

so through the use of a line buffer, reading out each 
video line twice for each line of the high-resolution 
screen. This method, although it is quite simple to 
implement, has several major drawback. First, it 
assumes that the high-resolution display is exactly 

ss twice the scan rate of the incoming video. This is 
seldom the case, and always requires a gen-lock 
circuit at the very least to force this strict relation- 
ship between the video and the graphics. It also 
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fails to provide random access to the video in- 
formation from the host workstation, since there is 
no frame buffer to store the video information. 
Another method involves converting the video and 
graphics information into a common format (e.g. 
RGB) and storing the two into a single, common 
frame buffer. While this may at first seem to be an 
advantage in that only one frame buffer is required, 
it can be seen that the requirements on this buffer 
require far more memory than having two separate 
dedicated buffers. Consider the following: 
High-resolution graphics has limited color content 
(typically 8 or less bits/pixel) while having a large 
number of pixels (typically 640x480. 1024x768. or 
higher). On the other hand, video information is rich 
in color information (16-24 bits/pixel) but only limit- 
ed resolution (780x480 or less), in order to use a 
single frame buffer to store both types of visual 
data, a very large frame buffer is required that is 
both "wide" and "deep" (e.g. 1024x768x24). Also, 
by storing both types of information in a common 
frame buffer, the available update bandwidth has to 
be shared between the two contending processes. 

By using a separate dedicated frame buffer for 
the incoming video information, a memory organi- 
zation optimized for the unique characteristics of 
motion video can be used. In addition, the update 
of the host computer's high-resolution graphics 
screen is unimpeded by the process of sampling 
live video. 



display controller which is shown generally in FIG. 
1; 

FIG. 4 is a block diagram of the sync gener- 
ator which is shown generally in FIG. 3; 
s FIG. 5 is a block diagram of the source 

control logic which is shown generally in FIG. 4; 

FIG. 6 is a diagram illustrating sampling re- 
gion parameters and sampling destination address- 
es; 

jo FIG. 7 is a block diagram of the FIFO shown 

generally in FIG. 3; 

FIG. 8 is a block diagram of the memory 
controller and arbiter shown generally in FIG. 3; 

FiG. 9 is a block diagram of the address 
is generator shown generally in FIG. 3; 

FIG. 10 is a block diagram of the video 
buffer shown generally in FIG. 3; 

FIG. 1 1 is a block diagram of the serializer 
shown generally in FIG. 3; 
so FIG. 12 is a block diagram of the color key 

network shown generally in FIG. 3; 

FIG. 13 is a block diagram of the digital 
audio circuitry shown generally in FIG. 1; 

FIG. 14 is a block diagram of the digital TV 
25 input circuitry shown generally in FIG. 1 ; 

FIG. 15 is a block diagram of the digital TV 
output circuitry shown generally in FIG. 1; and 

FIG. 16 and 17 are timing diagrams which 
are useful in the understanding of the invention. 

30 

Description of The Preferred Embodiment 



DIGITAL TELEVISION APPROACH 

The use of a standard off-the-shelf digital TV 
chip set offers many advantages. These include 
low cost, ready availability, more accurate control 
of video parameters, ready acceptance of a wide 
variety of TV standards for worldwide use, and 
convenient access for digital communications net- 
works. It is also important to select a chip technol- 
ogy that uses the CCITT 601 recommendation of 
sampling video with a frequency that is an integer 
multiple of the incoming video Horizontal Sync 
period. This feature eliminates the jitter that results 
when a sub-carrier based system is used in con- 
junction witb a non-standard source, such as a 
VCR or videodisk. 



Brief Description of The Drawings 



FIG. 1 is a block diagram of an audio video 
interactive display; 

FIG. 2 is a block diagram illustrating the dual 
buffer concept; 

FIG. 3 is a block diagram of the audio video 



The system herein described may have many 

35 of the specific characteristics generalized to ac- 
commodate future improvements in digital televi- 
sion and personal computer display technologies 
without departing from the spirit of the invention. In 
this embodiment, the digital television subsystem is 

40 based on a chip set manufactured by Philips. The 
host system is an IBM Personal System/2 Model 
70, which includes a VGA graphics (640x480x4 bit 
pixel) subsystem. A 12-bit luminance chrominance 
(Y-C) representation is referred to here, however 

45 the concepts described can be generalized to in- 
clude systems with wider (e.g. 16 or more bits) 
data paths and higher bandwidths e.g. high defini- 
tion television (HDTV). In addition, the high-resolu- 
tion video described need not be limited to the 

so bandwidth and bits/pixel provided by the VGA. Fu- 
ture digital TV and graphics technologies can read- 
ily be incorporated without departing from the spirit 
of this invention. 

55 

AUDIO VIDEO DISPLAY CONTROLLER 

FIG. 1 is a system block diagram showing how 
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a Audio Video Display Controller 100 interfaces to 
the other components of the system. It takes inputs 
from digital TV input circuitry 200, a host computer 
300, and a digital audio circuitry 400. The host 
computer may receive input commands from input 
devices such as a mouse 340 and keyboard 360. 
The controller 100 provides outputs to the host 
computer 300, a digital TV output circuitry 500, the 
digital audio circuitry 400, and a high-resolution 
monitor 600 via the digital TV output circuitry 500. 
The digital TV input circuitry 200 and the digital TV 
output circuitry 500 are of the type set forth in 
Phillips Corporation's manual 9398 063 30011 , date 
of release 6/88 entitled "Digital Video Signal Pro- 
cessing." 

The digital TV input circuitry 200 receives a 
plurality of analog input signals VIN1, VIN2 and 
VIN3 which may be, for example a cable TV input, 
a TV antenna input, a VCR input or the like. It is to 
be appreciated there may be more or less video 
inputs from different combinations of TV video 
sources, such as two or more VCR inputs, two or 
more cable inputs etc. 

The digital TV input circuitry responds to these 
analog input signals to provide a plurality of digitiz- 
ed TV output signals to the audio video display 
controller 100. These output signals include a TV 
clock or sampling clock signal TVCK; horizontal 
and vertical sync signals TVHS and TVVS, respec- 
tively; and a digitized TV data signal YCIN. Control 
signals are provided to the input circuit 200 from 
controller 100 on a control bus SVIN, which may 
also be known as an l 2 C bus. 

The host computer 300, which for example 
may be an IBM Personal System/2, the operation 
of which is described in detail in the IBM Personal 
System/2 Model 50 and 60 Technical Reference, 
provides a plurality of signals to the controller 100. 
These signals include a PC data signal (PCDATA) 
which may include graphics information for inser- 
tion in the on screen portion of a TV frame buffer 
145 (FIG. 3), or digitized audio to be stored in an 
off screen portion of buffer 145 for subsequent play 
by audio circuit 400, or other data applications; a 
PC address signal (PCADDR) which indicates 
where PCDATA is to be stored in the frame buffer 
145 (FIG. 3); PC control signals (PCCNTL); video 
data for high resolution display (VDAT); high reso- 
lution horizontal and vertical sync signals, (HRHS) 
and (HRVS), respectively; a high resolution blan- 
king signal (HRB); a high resolution clock signal 
(HRCK); and high resolution red, green and blue 
signals. (HRRGB) from a high-resolution buffer in 
the host 300 is provided to the digital TV output 
circuitry 500. 

The Digital Audio Circuitry 400 receives a plu- 
rality of audio inputs such as audio in left (AINL) 
and audio in right (AINR) from audio sources such 



as microphones. CD players, stereo audio sources 
and the like. Audio output signals, audio out left 
(AOUTL) and audio out right (AOUTR) are provided 
to amplifiers and speakers (not shown). The control 

5 of the digital audio circuitry is provided by a plural- 
ity of signals from the audio video display control- 
ler 100. These signals include a sampling clock 
signal for audio (SCAUD); an audio control or sync 
signal (ACTL); and an audio data signal ADAT. 

10 The audio video display controller 100 re- 

sponds to the respective signals from input cir- 
cuitry 200, host 300 and audio circuitry 400 to 
provide a plurality of signals to the digital TV 
output circuity 500. These signals include control 

75 signals on bus l 2 C; a TV video image out (YCOUT); 
and a video color switch signal (KEY) which selects 
between the TV image YCOUT and the high reso- 
lution image HRRGB from the host for display on 
the high resolution monitor 600. Red, green and 

20 blue output signals ROUT, GOUT and BOUT, re- 
spectively are applied to the monitor 600 from TV 
output circuitry 500. 

Refer now the FIG. 2 which illustrates in gen- 
eral the dual frame buffer concept of the invention. 

25 A more detailed description is set forth in the 
remaining figures. As previously stated, relative to 
FIG. 1, the digital TV output circuitry 500 selects 
between a standard digital TV video signal from a 
buffer in the audio video display controller 100 and 

30 a high resolution graphics video signal from a buff- 
er in the host computer 300. In FIG. 2, a logic 
block 700 includes a digital TV chip set 710, which 
is a composite of digital TV input and output cir- 
cuitry 200 and 500. respectively of FIG. 1; a TV 

35 frame buffer 720 and VLSI controller 730 which are 
included in the audio video display controller 100 
of FIG. 1 ; and a switch 740 which is included in the 
digital TV output circuitry 500 of FIG. 1. A Video 
Graphics Adaptor (VGA) display controller 750 and 

40 a high resolution frame buffer 760 are connected to 
a PC bus 770 and are included in the host com- 
puter 300 of FIG, 1. The PC bus is also connected 
to the digital TV chip set 710 and controller 730. 
The controller 730 receives PCDATA, PCADDR 

45 and PCCNTL on the PC bus; The PC data may be 
host computer graphics data which is stored in an 
on screen portion of buffer 720; or PC digital audio 
data which is stored in an off screen portion of 
buffer 720. This is described in detail relative to 

so FIGS. 3 and 10. 

In practice, an NTSC TV video signal is pro- 
vided to chip set 710 and is converted to a digitiz- 
ed TV speed signal which is written to the TV 
frame buffer 720 under control of controller 730. A 

55 TV modified speed video signal is read from the 
buffer 720, also under control of controller 730 to 
chip set 710. The read and write operations are 
asynchronous with respect to each other. A TV 
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RGB signal is then provided from chip set 710 as a 
first input to switch 740. This first input is from the 
TV Frame buffer. High resolution video information 
such as graphics video information is provided on 
PC 8uss 770 to VGA display controller 750. which 
in turn provides high resolution pixel data to frame 
buffer 760. Buffer 760 provides a high resolution 
graphics RGB signal to a second input of switch 
740. Switch 740 under control of control signals 
from computer 300 selects which of the dual buff- 
ers 720 and 760 provides a RGB video signal to 
the high resolution VGA monitor at a given time. At 
any given time, the following is viewed on the VGA 
monitor: 

1) An all TV image from buffer 720. 

2) An all graphics image from buffer 760. 

3) A TV image from buffer 720 with at least 
one window of graphic images from buffer 760. 

4) A graphics image from buffer 760 with at 
least one window of TV images from buffer 720. 

A detailed description of the respective image 
generations and selection process is set forth in 
detail below. 

FIG. 3 is a detailed block diagram, showing the 
various components of the display controller 100. 
The disptay controller 100 includes transceivers 90 
and 92, a serial interface 94, a sync generator 105; 
FIFO logic 115; memory controller and arbiter 125; 
address generator 135; video buffer 145; serializer 
155; and color key 165. 

The general operation of audio video display 
controller 100 is as follows, A sync generator 105 
receives the TV clock signal (TVCK), TV horizontal 
sync signal (TVHS) and the TV vertical sync signal 
(TWS) and in response thereto generates an audio 
control signal (ACTL) which is sent to the digital 
audio circuitry 400 and memory control and arbiter 
125 to indicate when control of audio operations is 
to take place. A SREG signal output is utilized by 
the memory control and arbiter 125 for windowing 
operations. 

A FIFO 115 buffers incoming TV video data 
YCIN under control of TVCK and SGNT from mem- 
ory control and arbiter 125. Video out from the 
FIFO 115 is provided to the video bus (VIDBUS) 
when SGNT is high. The VIDBUS also receives 
data from transceiver AXCVR 90 and transceiver 
XCVR 92. AXCVR 90 transmits to, and receives 
digital data (ADAT) from digital audio circuit 400. 
XCVR 92 receives PC data from host 300. This PC 
data may comprise graphics video in the on screen 
portion of video buffer 145, or digital audio for 
storage in the off screen portion of video buffer 
145. Memory control and arbiter 125 controls which 
of FIFO 115, AXCVR 90 and XCVR 92 is providing 
data to the VIDBUS at a given time, based on the 
state of SGNT or AGNT or PGNT, respectively. 
When the PC data is audio data that is stored in 



the off screen portion of video buffer 145, this 
audio data may then be subsequently read out and 
provided to AXVR 90 and transmitted to digital 
audio circuit 400 for subsequent replay. 

s The memory controller and arbiter 125 arbi- 

trates for various requests for memory cycles un- 
der control of PC control signals (PCCNTL) from 
host 300. Besides the control signals utilized for 
FIFO 115, AXCVR 90 and XCVR 92, as discussed 

io above, control signals are also provided to address 
generator 135 and video buffer 145. Buffer 145 
receives a video control signal (VBCTRL) and ad- 
dress generator 135 receives a MOP and DONE 
signals, which are described shortly. 

75 Address generator 135 receives PC addresses 

(PCADDR) from host 300 which are indicative of 
where PC data is to be stored. Addresses 
(VBAADDR) are provided to the video buffer 145 to 
indicate where data on the VIBUS is to be stored. 

20 The PCADDR is also applied to a serial inter- 

face 94 which connects to the 1 2 C bus. providing 
SCVIN to digital input circuitry 200; SCVOUT to 
digital output circuitry 400, and SCAUD to digital 
audio circuitry 400. 

25 Serializer 155 takes the video data out from 

video buffer 145 and provides it to digital TV output 
circuitry 500. Color key 165 provides a KEY signal 
to digital TV output circuitry 145 for determining 
which video is displayed on high resolution display 

30 600 at a given time. 

The main components of audio video display 
controller 100 are described in detail below. 



35 SYNC GENERATOR 105 

The main purpose of the Sync Generator cir- 
cuit 105, as shown in FIG. 4, is to generate re- 
quests to the memory controller for a video sam- 

40 pling cycle whenever the incoming TV raster is 
within a user-specified region. All information inside 
this region is written into the video buffer 145. while 
all information outside of this region is ignored. 
FIG. 6 illustrates how the "video sampling region" 

45 is defined. There are four parameters written to the 
Sync Generator 105 by the host computer 300. 
These are: XStart, XEnd, YStart, and YEnd. 

Referring to FIG. 4, it is seen that two counters 
are employed to keep track of where in the TV 

so raster the incoming video is from. For each incom- 
ing video "pixel" a horizontal counter (HCNT) 106 
is incremented by the clock signal TVCK, which 
has the same frequency as the incoming digital 
video data. In this embodiment, this frequency is 

55 13.5 MHz or 910 times the period of TVHS-. At the 
end of a scanline. this counter is reset {by TVHS-). 
In a similar manner, a vertical counter (VCNT) 107 
is incremented by TVHS-one time for every scan- 

5 
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line of incoming video. It is reset at the end of a 
field by the TWS- signal. A source control logic 
receiver has as inputs, PCDATA, and the outputs 
from counters 106 and 107. An audio timing logic 
109 has a single input from counter 106. 

The source control logic 108 is shown in FIG. 
5, and is comprised of two pairs of comparators, 
one pair 110 and 111 for horizontal comparison, 
one pair 112 and 113 for vertical comparison. 
When the X- coordinate of the incoming raster falls 
between XSTART 114 and XEND 115, the signal 
INX from gate 116 is asserted. Similarly, when the 
Y- coordinate of the incoming raster falls between 
YSTART 117 and VEND 118, the signal INY from 
gate 119 is asserted. When both signals are true, 
the raster is within the rectangular region depicted 
in FIG. 6. and the Sync Generator 105 generates a 
Sample Request (SREQ) from gate 120 to the 
memory controller and arbiter 135. 

An additional function of the Sync Generator 
105 is to generate the appropriate timing signals to 
control the digital audio circuit by the audio timing 
logic 109 (FIG. 4). The timing is generated based 
on the video clock, TVCK which controls counter 
106, the output of which controls logic 109. The 
audio sample rate is based on an integer divisor of 
TVCK. For the system shown, the rate is approxi- 
mately 64KH2. Every audio sample is initiated by 
the assertion of an Audio Request (AREQ) signal at 
a first output of logic 109. An LR signal at a second 
output of logic 109 toggles back and forth on every 
other audio request, causing the left and right audio 
channels to be digitized or played back on al- 
ternate audio cycles. This yields an effective sam- 
pling rate of 32 KHz per channel in this embodi- 
ment. An AUDDIR signal at a third output of logic 
109 is a control register bit that determines the 
type of audio cycle being requested. If AUDDIR is 
0, an audio record (digitize) cycle is performed. If 
AUDDIR is 1, an audio playback cycle is per- 
formed. This signal is used directly to control the 
direction of the Audio Transceiver (AXCVR). 

A Rlter Clock signal (FCK) at a fourth output of 
logic 109 is used to clock the pre- and post- filters 
at the appropriate rate. This frequency directly de- 
termines the cut-off frequency of these low-pass 
filters. For a sample rate of 32 KHz, the cutoff 
frequency should be no more than 16 KHz accord- 
ing to the Nyquist Theorem. If a lower sampling 
rate is required, for example to handle speech- 
quality audio, or to reduce host storage require- 
ments, the frequency of FCK would have to be 
lowered correspondingly. 

FIFO LOGIC 115 

The FIFO 115 shown in FIG. 7 is used to buffer 



the continuous stream of incoming video data while 
the memory controller is busy handling other re- 
quests, such as memory refresh. Whenever sam- 
pling is taking place, as indicated by SREQ being 

s asserted at gate 116, video data on line 117 is 
shifted into the FIFO at the rate of one video 
sample per TV Clock (TVCK) at gate 119. As long 
as the memory controller is actually performing 
Sample cycles (indicated by the fact that Sampling 

w Grant on line 120, or SGNT, is asserted), video 
data can be shifted out of the other end of the 
FIFO on line 121, also at the TVCK rate. 

If however the memory controller is busy per- 
forming another cycle, SGNT on line 120 is not 

is active, and no data is clocked out of the FIFO, Any 
samples that arrive during this time, accumulate in 
the FIFO. The FIFO only drives data onto the Video 
Bus (VIDBUS) 121 when it has been granted ac- 
cess to the bus (when SGNT = 1 ) by the Memory 

20 Controller/Arbiter. 



MEMORY CONTROLLER AND AR81TER 125 

25 This circuit, illustrated in FIG. 8, is responsible 

for arbitrating between the various requests for 
memory cycles, and then carrying out the cycle by 
generating the appropriate control signals to the 
video buffer 145. It also signals to the other com- 

30 ponents in the system which memory cycle it is 
currently performing, as well as providing an in- 
dication that the current cycle is complete. It con- 
trols access to the shared Video Data base 
(VIDBUS) via a request/grant protocol. Although 

OS multiple devices are attached to the Video Bus, this 
scheme assures that only one device at a time is 
allowed to drive data onto it. Finally, it can delay 
the host computers I/O cycle long enough to in- 
sure that the host's data has been safely written to 

40 or read from the Video Buffer. 

There are four possible requests that come to 
the memory controller and arbiter 125, and are 
applied to the arbiter logic 126. These are: Audio 
Request (AREQ), Sample Request (SREQ), Trans- 

45 fer Request (TREQ), and PC Request (PREQ). 
There are two additional signals that specify the 
direction of the Audio and PC cycles requested. 
These are AUDDIR and PCDIR, respectively. In 
these two cases, the sequence of control signals 

so generated depends on the whether the memory 
cycle is a read or a write. Each of the requests has 
a predefined priority in the arbitration scheme. In 
decreasing priority, they are: 
1 . TREQ 

55 2. AREQ 

3. SREQ 

4. PREQ 

The arbiter 126 provides input to a memory 
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controller section 127. When the current memory 
cycle is completed, a DONE signal is asserted at 
the output of controller 127. indicating this fact. At 
this time, the currently asserted request with the 
highest priority is serviced. If the serviced request 
requires use of the common Video Bus, the re- 
questing device is given control of the bus via an 
appropriate Grant signal. The grant signals are 
Audio Grant (AGNT), PC Grant (PGNT), and Sam- 
ple Grant (SGNT) provided at respective outputs of 
arbiter 126. Note that the PGNT signal is used to 
enable the PC data bus transceiver (PXCVR), while 
the direction of this transceiver is controlled by the 
PCDIR signal. 

Once arbitration is completed, the memory cy- 
cle appropriate to the winning request is per- 
formed. A memory operation code (MOP) is pro- 
duced, indicating the type of memory cycle cur- 
rently being performed. 

The specific sequence of control signals for the 
Video Buffer 145 depends on the particular VRAM 
devices used to construct it. The control signals 
are typical of all DRAM devices, with the exception 
of the TR/QE-signal, which is typical of VRAMs 
only. Note that their are two separate Write Enable 
signals (WEY- and WEC-) at the output of control- 
ler 127. This allows separate write access to the 
Luminance (Y) and Chrominance (C) information in 
the Video Buffer 145. For example, to write a 
monochromatic image of the incoming video, the 
Video Buffer could first be cleared, and then only 
the Luminance information would be sampled, 
keeping the Chrominance Write Enable signal 
(WEC-) inactive (high) throughout. 

A typical set of timing diagrams is shown in 
FIGS. 16 and 17. These control sequences are 
generated using a generic sequences design, 
which progresses through multiple states until a 
given sequence (memory cycle) is completed. At 
this time the DONE signal from controller 127 is 
asserted, indicating to the other subsystems that 
the current cycle is completed. 

When the host computer requests a memory 
cycle (via PREQ to arbiter 126), the RDY signal 
from controller 127 is immediately brought inactive 
(low) in order to extend the host's bus cycle long 
enough to transfer the data to the video buffer 145. 
When the data transfer is complete, the RDY signal 
is released, allowing the host computer 300 to 
complete the bus cycle. 

ADDRESS GENERATOR 135 

The Address Generator circuit 135 shown in 
FIG. 9 provides all addresses for the various Video 
Buffer memory cycles outlined above. It includes 
separate, dedicated counters for Sampling 136, 



Host (PC) 137, Display Refresh 138, and Audio 
addressing 139. As various cycles repeatedly take 
place, this circuit automatically updates the coun- 
ters so that the appropriate region of the Video 
5 Buffer is accessed. There is a large multiplexor 140 
which selects the counter output appropriate for the 
current operation and correctly divides the address 
into row and column components for successive 
output to the Video Buffer during RAS- and CAS- 
io respectively. 

The Sample Address Counters 136 generate a 
sequence of addresses that fill a rectangular region 
of the Video Buffer 145 corresponding in size with 
the input region selected by the Sync Generator 
15 105. The upper left corner of this region is stored 
in two registers: Sampling Destination X-address 
(SDX) 141 and Sampling Destination Y-address 
(SDY) 142. These registers are set by the host 
computer using the PCDATA bus. Refer to FIG. 6. 
20 As each sampling memory cycle completes (as 
indicated by decoding the Memory Operation 
(MOP) to MOPSAMP via the Memory Operation 
Decoder 143, and finding DONE asserted), the 
Horizontal Sampling Address (HSADDR) incre- 
25 ments across a scanline. At the end of each scan- 
line, as signalled by TVHS-, the Vertical Sampling 
Address (VSADDR) is incremented by 1. and 
HSADDR is reset to its initial value (SDX). At the 
end of a field, as signalled by TVVS-, VSADDR is 
30 reset to its initial value (SDY). 

The Host (PC) Address counters 137 operate in 
a manner very similar to the Sample Address coun- 
ters 136. As each host memory cycle completes 
(as indicated by decoding MOP = MOPPC and 
35 DONE asserted), the Horizontal PC Address 
(HPADDR) increments. After a full line of video has 
been read from (or written to) the video buffer 1 45 
by the host 300. the Vertical PC Address 
(VPADDR) increments, and HPADDR is reset to its 
40 initial value. The upper left corner of the region 
accessed by the host is determined by the PC 
Destination X-address (PDX) register 144 and PC 
Destination Y-address (PDY) register 146, both of 
which can be set via the host data bus (PCDATA). 
45 This auto-increment scheme allows the host com- 
puter to fill a rectangular region of the Video Buffer 
145 with a single stream-oriented instruction, such 
as the OUTSW or 1NSW instruction of the Intel 
80X86 processors, 
so The Video Refresh Counter (VREF) 138 is used 

to determine which scanline of video memory is to 
be transferred to VRAM serial port on the next 
Video Refresh (TR/QE-) cycle. During each Hori- 
zontal Sync interval of the host's high resolution 
55 display (HRHS-), one scanline of VRAM must be 
transferred, so that the contents of the appropriate 
scanline in the Video Buffer 1 45 can be shifted out 
synchronously with the high-resolution display 600. 
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The particular sequence of Video Buffer scanlines 
transferred can be controlled by the host 300 using 
the Refresh Mode Register (REFMODE) 147. Nor- 
mally, the lines are transferred progressively, with 
the Video Refresh Address (VREF) incrementing 
by one after each scanline is transferred. This in 
known as progressive scan mode. This mode pro- 
vides the highest effective vertical resolution, but 
exhibits some "scalloping" artifacts if the subject 
moves horizontally from one field to the next. The 
subject is seen in one position on the even scan- 
lines, and in another on the odd ones in between 
The effect is most noticeable in distinct vertical 
edges with substantial horizontal motion. 

For this reason, another mode, called double- 
scan mode, is provided. Here, each Video Refresh 
Address is used twice in succession, resulting in 
each of the incoming scanlines in the first (even) 
TV field being shown twice in the first high-speed 
output frame. Ouring the next (odd) TV field, the 
Video Refresh address are again used twice each, 
causing the scanlines in the next-speed output 
frame to again be doubled. This mode has slightly 
lower vertical resolution than the progressive mode, 
but is more appropriate for images that exhibit 
artifacts using that mode. Since the scanlines are 
doubled, each high-speed output frame only con- 
tains information from one incoming TV field, so no 
scalloping occurs. 

The Horizontal and Vertical Audio Addresses 
(HAUDADDR and VAUDADDR) are produced by 
the auto incrementing Audio Counters 139 when 
PCDATA from host 300 is audio data. They pro- 
duce a sequence of addresses corresponding to an 
off-screen region portion of Video Buffer 145. After 
each audio memory cycle completes (as indicated 
by MOPAUD and DONE asserted), the counters 
increment, so that the next audio data from host 
300 is sorted in contiguous locations in the Video 
Buffer 145. . 

The Address Multiplexor 140 performs two 
functions in parallel. First, it selects the appropriate 
address "type" from among the counters, Sam- 
pling 136, Host (PC) 137, Video Refresh 138, and 
Audio 139. Second, each of these address types 
must be split into it's row and column components 
before being driven to the VRAM array. So there 
are actually 8 possible inputs to the MUX 140, 
divided into 4 pairs. The appropriate pair is deter- 
mined by examining the two high order bits of the 
MOP (the LSB of MOP is only used to indicate 
direction). The Row Address component must drive 
the Video Buffer Address while RAS- falls, in order 
to be strobed into the VRAM's Row Address 
latches. Once RAS- has fallen, the Column Address 
component of a pair is selected. Note that the 
Column Address component of the Video Refresh 
Address is always exactly 0. This is because it is 



necessary to start shifting video samples out of the 
Video Buffer starting with the leftmost sample 
(column 0). 

5 

VIDEO BUFFER 145 

The Video Buffer 145 shown in FIG. 10 is an 
array of Video Memories including an on screen 

w portion and an off screen portion. The on screen 
portion is used to store the live TV video image 
data as it comes in, and to store PC DATA when it 
is graphics data. In this particular embodiment, the 
organization is 1,024 video samples across by 512 

re scanlines high by 12 bits deep, being comprised of 
61 Megabit (512x512x4 bit) devices. These num- 
bers were chosen to accommodate the specific 
resolution and depth characteristics of the digital 
TV chip set used. For future digital TV systems 

20 having either higher resolution or deeper samples, 
it is simple to change the size of the video buffer to 
accommodate the new system's characteristics. 
The off screen portion is used to store PC DATA 
when it is audio data. It is to be appreciated that 

25 two separate memories could be utilized in the 
practice of the invention, that is a first memory to 
store TV video data and graphics data from the 
host 300; and a second memory to store audio 
data from the host 300. 

30 The incoming data bus (VIDBUS) 148 carries 

all information to and from the primary port of the 
VRAM array. This includes incoming TV video data 
to be sampled, digital audio data (in PC DATA and 
out), and host computer graphics data (PC DATA in 

35 and out). The particular access being performed is 
determined via standard control signals RAS-, 
CAS0-. TR/QE, WEY- by the memory controller 
125 described above. The address at which a 
given cycle takes place is determined by VBADDR, 

40 which is provided by the Address Generator circuit 
135, also described above. As set forth above, TV 
video data and host computer graphics data are 
stored in the on screen portion; and host audio 
data is stored in the off screen portion of video 

45 buffer 145. 

Note that there are left and right halves of the 
Video buffer. Each half has a unique CAS-Line, 
which allows a 2:1 interleaved access to the Frame 
8uffer. This effectively halves the cycle time re- 
st? quired to transfer data into the Buffer. This is 
critical, since the incoming video samples are be- 
ing clocked out of the FIFO 115 at the TVCK rate, 
or approximately every 70 nsec in this system. The 
fastest page mode cycle that can be performed 

55 using today's VRAM technology is around 90nsec. 
By using 2:1 interleave, effective page mode ac- 
cess times as fast as 45nsec are achieved, which 
is sufficient for current motion video data rates. For 
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significantly higher data rates, higher interleave ra- 
tios and deeper Video Buffer organizations are 
required. 

There are separate Write Enable signals for 
Luminance and Chrominance, for reasons men- 
tioned above under the Memory Controller 125 
description. 

There are two separate 1 2-bit serial data bus- 
ses shown here, one for each of the left and right 
halves. Every time the VRAM serial ports are shift- 
ed via the SC signal from the serializer 155, two 
separate video samples are shifted out. The 
serializer 155, described below, takes these two 
samples and presents them sequentially. The rate 
at which video samples are shifted out of the 
VRAMs is completely independent of the rate at 
which video samples are put in t being limited only 
by the maximum serial clock frequency of the 
devices, which is typically 25 MHz or higher. This 
is the primary advantage of using VRAMSs as the 
video buffer, since the host's high-resolution dis- 
play will in general be completely asynchronous 
from the incoming digital video data. Again, the 
effective data rate of the VRAM serial outputs is 
twice the serial shift clock (SC) frequency, due to 
the 2:1 interleaving. For output video data rates in 
excess of 50MHz, higher interleaving ratios or 
deeper buffer organizations are again required. 



SERIALIZER 155 

The serializer 155, shown in FIG. 11, takes the 
incoming serial data from the Video Buffer 145 
along 2 parallel 1 2-bit paths, SDATO on line 156 
and SDAT1 on line 157, and serializes them by a 
multiplexor 158, shifting them out onto the high- 
speed Luminance-Chrominance output data bus 
(YCOUT) one 12-bit sample at a time by flip-flop 
159. The YCOUT is clocked synchronously with the 
host's high resolution display dot clock (HRCK). In 
the present embodiment, it is clocked using the 
same signal. This clock frequency can be in- 
creased by some fractional amount while remaining 
synchronous with HRCK using conventional phase- 
locked loop techniques. This may be necessary, 
for example, to correct the aspect ratio of the videQ 
image on the high-resolution screen. There is also 
a high-resolution blanking signal (HRB-), which is 
used to force the YCOUT data to 0 (black) and also 
to delay the start of clocking data out of the Video 
Buffer's serial ports (via SC) from gate 160 as 
controlled by flip-flop 161, until the active portion of 
the high-resolution scanline starts. 



COLOR KEY 165 



The Color Key circuit 165, shown in FIG. 12, is 
used to generate a keying signal (KEY) on output 
line 166, which in turn is used by the digital TV 
output circuitry 500 to switch between TV video 

s pixels (from the YCOUT bus) and the pixels from 
the host's high-resolution graphics controller. With 
reference to FIG. 2, every pixel during which KEY 
is asserted is seen on the monitor as video from 
the TV frame buffer 720, while those during which 

jo KEY is low are seen as video from the high- 
resolution frame buffer 760. 

The KEY signal on line 166 from key select 
logic 167 is determined in comparator 168 by 
comparing the incoming high-resolution pixel with 

/5 two pre-defined colors set by the host computer as 
manifested by Key 1 logic 169 and Key 2 logic 
1 70. If the incoming pixel is between the two pro- 
grammed values (R1 < A < R2), the key signal is 
asserted. This allows a range of colors to be speci- 

20 fied for which video will be overlayed. If it is 
desired to have only one specific color overlayed 
with video, the KEY signal should be derived from 
the A = R1 comparator 168 output and R1 should 
be programmed with the keying color. 

25 Several interesting effects can be obtained by 

using different outputs of the comparator 168. For 
example, if the A < R1 output is used, all high- 
resolution pixels having a value less than R1 are 
seen as video. By painting a graphics object with 

30 concentric rings of increasing color value, interest- 
ing "growing" and shrinking" window effects can 
be achieved by dynamically varying the threshold 
value, R1 . 



DIGITAL AUDIO CIRCUIT 400 

This circuitry, shown in FIG. 13, serves as the 
audio Input/Output subsystem in the system. The 

40 incoming analog, stereo audio (AINL 402 and AINR 
404) signals to input gain and balance control cir- 
cuit 406 are first gain and balance adjusted appro- 
priately and are subsequently low-pass prefiltered, 
so that they contain no frequency content above 

45 the Nyquist Frequency. The gain and balance can 
be controlled by the host computer 300 via the 2- 
bit serial data bus 408 (SCAUD). 

Once the signals have been conditioned, they 
must be multiplexed onto a common wire by a 

so multiplexor 410, in order to avoid the need for two 
separate Analog-to-Digital (A/D) convertors. Every 
other audio sample written into the video buffer 
comes from alternating channels of the incoming 
audio source. This toggling is performed via the 

55 UR signal 412 generated by the sync generator 
105. The sync generator 105 also generates the 
basic timing pulses for the audio conversion pro- 
cesses. When the digital audio data is being re- 
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corded, (AUDDIR = 0) on line 41 4, the timing pulses 
(AREQ) on line 416 are applied only to the A/D 
converter 418 via gate 420. Similarly, if AUDDIR = 1 
(playback mode) on line 414, AREQ on line 416 are 
only be applied to the Digital-to-Analog convertor 
(DAC) 422 via gate 424. Each time one of the 
converters 418 or 422 receives a convert pulse, it 
provides one sample of audio (A/D), or take one 
sample and convert it to analog (DAC). These 
audio samples are read from or written to off- 
screen regions of the Video Buffer by the memory 
controller. 

The DAC used in this system is actually a dual 
channel DAC, taking a single digital input and pro- 
viding two analog outputs. The two output voltages 
are updated on every other DAC conversion cycle, 
in a similar manner to the A/D. After the DAC, there 
is once again analog audio, which must be pro- 
cessed through a reconstruction filter 426 in order 
to remove unwanted artifacts of the sampling pro- 
cess (i.e. quantization noise). This reconstruction 
filter has a cutoff frequency identical to that of the 
input filter. The cutoff frequency is controlled by 
the frequency of the FCK signal from the Sync 
Generator 105. Thus, a range of sample rates 
(hence cutoff frequencies) can be accommodated. 
Finally, there is an output amplifier 428, to restore 
the signals to a level sufficient to drive an audio 
pre-amp or headphones. 

An interesting additional feature of this circuit is 
the ability to monitor the digital audio through the 
DAC as it is being recorded from the A/D. This can 
be done by driving both the A/D and DAC convert 
pulses simultaneously, which requires an obvious 
change in the logic shown in FIG. 13. This feature 
is a result of the fact that the A/D and DAC share a 
common data bus (ADAT). 



DIGITAL TV INPUT CIRCUIT 200 

FIG. 14 shows a typical system for providing 
the digital video input processed by the rest of the 
system. The video input can be selected by a 
video source select logic 202 from one of several 
sources under host control through the use of a 1 2 C 
serial control bus. (This bus is standard for control 
Philips chips and described in Signetics/Philips 
data books as previously referenced). In addition, 
these sources can be any of a variety of formats 
including PAL, NTSC. SECAM, SVHS.RGB, etc. 
This is a virtue of the digital television approach, 
since these devices have been designed with that 
flexibility in mind. After a source is selected, it is 
digitized using a conventional video A/D convertor 
204. An 8 bit digital output is shown, but again, this 
is not a fundamental limitation, and higher resolu- 
tions provided by future systems can be readily 



accommodated. This digitized video is then pro- 
cessed by a Digital Multi-Standard Decoder 
(DMSD) 206, driving a 12-bit digital 
Luminance/Chrominance Input Bus (YCIN) 208 at 
5 the TV data rate (TVCK). It is the DMSD 206 that 
interprets the variety of input video formats and 
decodes them appropriately. Various parameters of 
the decoder can be adjusted via the serial control 
bus l 2 C. 

ro A Sync Separator circuit 210 simply extracts 

Sync and Clock information from the currently se- 
lected video input and provides this information 
(TVVS-, TVHS-TVCK) to the rest of the system. 

ts 

DIGITAL TV OUTPUT CIRCUIT 500 

This circuit, shown in FIG. 15, converts the 
high-speed Luminance/Chrominance Bus (YCOUT) 

20 information on line 502 back to analog RGB form 
by a convertor 504 and video Y and C to RGB 
matrix 506, and multiplexes it in a multiplexer 508 
with RGB signals 510 from the host's high-resolu- 
tion graphics controller, under control of the KEY 

25 signals on line 51 1 . 

The Y/C to RGB Matrix 506 is a purely analog 
component which converts the analog Y/C repre- 
sentation to RGB using a standard conversion ma- 
trix. Various adjustments to the output video 

30 (Saturation, Contrast, and Brightness) can be made 
by the host via the serial control bus l 2 C. 

Finally, the Video Multiplexor 508 selects be- 
tween the RGB-converted video and the RGB from 
the high-resolution display controller, on a pixel by 

35 pixel basis. This selection is done under control of 
the KEY signal on line 511 generated by the Color 
Key circuit of FIG. 12. The output 512 of the 
multiplexor 508 directly drives the high-resolution 
display 600. 

40 

Claims 

1. In a high resolution display system, the 
45 combination comprising: 

a high resolution monitor (600); 

a computer (300) for providing control signals, in-, 
eluding a high resolution frame buffer (760) for 
storing computer graphics images pel by pel, and 

50 reading out said graphics images on a pel by pel 
basis at a rate controlled by said control signals; 
a TV video controller (100). including a TV frame 
buffer which stores TV video at TV speeds and 
reads out TV video on a pel by pel basis at a rate 

55 controlled by said control signals from said com- 
puter; and 

a switching mechanism (500) controlled by said 
control signals from said computer for selectively 
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switching between said high resolution frame buffer 
and said TV frame buffer on a pel by pel basis to 
read out said buffers to display the read out video 
on said high resolution monitor. 

2. In a high resolution video display system, 
the combination comprising: 

a high resolution display (600); 
a computer system (300) for generating control 
signals, and including a high resolution frame buff- 
er (760) for storing video graphics pel by pel for 
display on said high resolution display, including 
means for converting the video graphics to an 
analog high resolution graphics signal; 
an input device (200) for receiving standard analog 
TV signals and converting them to standard digital 
TV signals; 

a display controller (100) which operates under 
control of said control signals from said computer, 
said display controller including a two port TV 
frame buffer, with said standard digital TV signal 
being read into the first port at a TV rate, for 
storage, and being read out of the second port on 
a pel by pel basis at a higher speed rate controlled 
by said control signals from said computer; and 
an output device (500) including a digital to analog 
converter (504) for converting the standard digital 
TV signal read out of the second port to an analog 
TV signal, and further including means (508) for 
selecting a pel at a time one of said analog high 
resolution graphics signal and said analog TV sig- 
nal for display on said high resolution display. 

3. The combination claimed in claim 1 or 2, 
wherein said display controller includes: 

a sync generator (105) responsive to a TV clock 
signal, horizontal sync signal and vertical signal 
portion of said standard digital TV signal to provide 
a TV sync signal for reading the data portion of 
said standard TV signal into said first port of said 
TV frame buffer; and 

a serializer (155) operating under control of said 
control signals from said computer for reading out 
the digital TV data from said second port of said 
TV frame buffer on a pel by pel basis to provide 
serial TV data at a high resolution rate; and 
a select network (508) responsive to said control 
signals from said computer for providing a key 
signal which when in a first state selects said TV 
video for display and when in a second state 
selects said high resolution graphics video for dis- 
play. 

4. The combination claimed in claim 3, wherein 
said means for selecting in said output device 
comprises a multiplexer (508) which bases its se- 
lection in response to said key signal. 

5. In a high resolution video display system, 
the combination comprising: 

a high resolution display (600); 

a computer system (300) for generating control 



signals, and video graphics signals; 
an input device (200) for receiving standard analog 
TV signals and converting them to standard digital 
TV signals; 

s a display controller (100) which operates under 
control of said control signals from said computer, 
said display controller including a two port display 
frame buffer, with one of said standard digital TV 
signal and said video graphics signal being read 

io into the first port at a first rate, and being read out 
of the second port pel by pel at a second rate 
controlled by said control signals from said com- 
puter; and 

an output device (500) including a digital to analog 
15 converter for converting the signal read out of the 
second port of said display frame buffer to an 
analog display signal, for display on said high 
resolution display. 

6. In a high resolution video display system, 
20 the combination comprising: 

a high resolution display; 

a computer system for generating control signals, 
video graphics signals, and digitized audio signals; 
an input device for receiving standard analog TV 
25 signals and converting them to standard digital TV 
signals; 

a display controller which operates under control of 
said control signals from said computer, said dis- 
play controller including a display frame buffer 

30 which includes an on screen portion and an off 
screen portion, with said standard digital TV signal 
and said video graphics signal being read for stor- 
age in predetermined locations in said on screen 
portion of said display frame buffer, with said 

35 digitized audio signals being read for storage in 
said off screen portion of said display frame buffer, 
and each being read out in response to said control 
signals from said computer; 

an audio circuit responsive to the digitized audio 
40 signals read out of said display frame buffer, in- 
cluding means for converting the digitized audio to 
analog audio; and 

an output device including a digital to analog con- 
verter for converting the standard TV signal and the 
45 video graphics signals read out of said TV frame 
buffer to an analog TV signal, for display on said 
high resolution display. 

7. The combination claimed in claim 5 or 6, 
wherein said frame buffer stores said standard TV 

so signal and said video graphics signal as scanlines, 
with each scanline being read out twice before the 
following scanline is read out. 

8. The combination claimed in claim 5, 6 or 7, 
including means for reading out said frame buffer 

55 pet by pel such that the image on said high resolu- 
tion display comprises either the standard TV sig- 
nal with at least one window image of video graph- 
ics, or the video graphics with at least one window 
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image of the TV signal. 

9. The combination claimed in claim 5, 6, 7 or 
8, wherein said computer system includes: 

a high resolution frame buffer (760) for storing 
video graphics, including means for reading out 
said video graphics at a rate controlled by said 
control signals; and 

means for converting the video graphics to an 
analog high resolution graphics signal; and 
wherein said output device includes: 
means for selecting one of said analog high resolu- 
tion graphics signal and said analog display signal 
for display on said high resolution display. 

10. In a high resolution video display system, 
the combination comprising: 

a high resolution display; 

a computer system for generating computer control 
signals, and computer data signals which include 
graphics data signals, and digitized audio data sig- 
nals; 

an input device for receiving standard analog TV 
signals and converting them to standard digital TV 
signals; 

a display controller which operates under control of 
said computer control signals from said computer, 
said display controller including a two port data 
buffer which includes an on screen portion and an 
off screen portion, with said standard digital TV 
signal and said computer data signals being read 
into the first port for storage of the digital TV signal 
and the graphics data signals in predetermined 
locations in said on screen portion of said data 
buffer, and for storage of said digitized audio data 
signals in said off screen portion of said data 
buffer, with said digitized audio data signals being 
read out of said first port under control of said 
computer control signals and said digital TV signal 
and the graphics data signals being read out of the 
second port at a speed controlled by said com- 
puter control signals; 

an audio circuit responsive to the digitized audio 
data signals read out of the first port of said display 
frame buffer, including means for converting the 
digitized audio data signals to analog audio; and 
an output device including a digital to analog con- 
verter for converting the standard TV signal and the 
graphics data signals read out of the second port 
of said data buffer to an analog display signal, for 
display on said high resolution display. 

11. The combination claimed in claim 10, 
wherein said display controller includes: 
a sync generator responsive to said standard digi- 
tal TV signal to provide a TV sync signal for 
reading the data portion of said standard TV signal 
into said first port of said data buffer; and 
a serializer operating under control of said com- 
puter control signals, for reading out display data 
from said second port of said data buffer to provide 



display data at a high resolution rate to said output 
device. 

12. The combination claimed in claim 10 or 11, 
wherein said data buffer stores data in the on 

5 screen portion as scanlines. with each scanline 
being read out twice before the following scanline 
is read out. 

13. The combination claimed in claim 10. 11 or 
12, including means for reading out said data buff- 

w er such that the image displayed on said high 
resolution display comprises either the standard TV 
signals with at least one window image of graphics 
data or the graphics data with at least one window 
image of the TV signal. 

75 14. The combination claimed in claim 10, 11, 

12 or 13, wherein said computer system includes: 
a high resolution frame buffer for storing video 
graphics, including means for reading out said vid- 
eo graphics at a rate controlled by said computer 

20 system; 

means for converting the video graphics to an 

analog high resolution graphics signal; 

wherein said output device includes: 

means for selecting one of said analog high resolu- 

25 tion graphics signal and said analog display signal 
for display on said high resolution display. 

15. In a high resolution video display system, 
the combination comprising: 
a high resolution display; 

30 a computer system for generating control signals, 
video graphics signals, and first digitized audio 
signals; 

an input device for receiving standard analog TV 
signals and converting them to standard digital TV 

35 signals; 

a display controller which operates under control of 
said control signals from said computer, said dis- 
play controller including a display frame buffer 
which includes an on screen portion and an off 

40 screen portion, with said standard digital TV signal 
and said video graphics signal being read for stor- 
age in predetermined locations in said on screen 
portion of said display frame buffer, with said first 
digitized audio signals being read for storage in 

45 said off screen portion of said display frame buffer, 
and each being read out in response to said control 
signals from said computer; 
a source of analog audio signals; 
an audio circuit including means for converting said 

so analog audio signals to second digitized audio sig- 
nals to be read into the off screen portion of said 
TV frame buffer for storage at predetermined loca- 
tions, and being read out under control of said 
control signals and being responsive to either the 

55 first digitized audio signals or the second digitized 
audio signals read out of said display frame buffer, 
including means for converting the digitized audio 
to analog audio; and 

12 
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an output device including a digital to analog con- 
verter for converting the standard TV signal and the 
video graphics read out of said TV frame buffer to 
an analog TV signal, for display on said high reso- 
lution display. 

16. The combination claimed in claim 15, 
wherein said frame buffer stores said standard TV 
signal and said video graphics signal as scanlines, 
with each scanline being read out twice before the 
following scanline is read out. 

17. The combination claimed in claim 15 or 16, 
including means for reading out said frame buffer 
such that the image on said high resolution display 
comprises either the standard TV signal with at 
least one window image of video graphics, or the 
video graphics with at least one window image of 
the TV. signal. 

18. The combination claimed in claim 15, 16, 
or 17, wherein said computer system includes: 

a high resolution frame buffer for storing video 
graphics, including means for reading out said vid- 
eo graphics at a rate controlled by said control 
signals; and 

means for converting the video graphics to an 
analog high resolution graphics signal; and 
wherein said output device includes: 
means for selecting one of said analog high resolu- 
tion graphics signal and said analog display signal 
for display on said high resolution display. 

19. In a high resolution video display system, 
the combination comprising: 

a high resolution display; 

a computer system for generating computer control 
signals, and computer data signals which include 
graphics data signals, and first digitized audio data 
signals; 

an input device for receiving standard analog TV 
signals and converting them to standard digital TV 
signals; 

a display controller which operates under control of 
said computer control signals from said computer, 
said display controller including a two port data 
buffer which includes an on screen portion and an 
off screen portion, with said standard digital TV 
signal and said computer data signals being read 
into the first port for storage of the digital TV signal 
and the graphics data signals in predetermined 
locations in said on screen portion of said data 
buffer, and for storage of said first digitized audio 
data signals in said off screen portion of said data 
buffer, with said first digitized audio data signals 
being read out of said first port under control of 
said computer control signals and said digital TV 
signal and the graphics data signal being read out 
of the second port at a speed controlled by said 
computer control signals; 
a source of analog audio signals; 
an audio circuit including means for converting said 



analog audio signals to second digitized audio sig- 
nals to be read into the first port of said data buffer 
for storage at predetermined locations of said off 
screen portion, and being read out of said first port 

5 under control of said control signals and being 
responsive to either the first digitized audio data 
signals or the second digitized audio signals read 
out of the first port of said display frame buffer, 
including means for converting the digitized audio 

;o signals read out of said first port to analog audio; 
and 

an output device including a digital to analog con- 
verter for converting the standard TV signal and the 
graphics data signals read out of the second port 
is of said data buffer to an analog display signal, for 
display on said high resolution display. 
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© A method and apparatus for synchronizing two 
independent rasters, such that a standard TV video 
and a high resolution computer generated graphics 
video may each be displayed on a high resolution 
graphics monitor. This is accomplished utilizing dual 
frame buffers. A TV frame buffer, comprises a dual 
port VRAM, with the serial and random ports operat- 
ing asynchronously. The primary port receives in- 
coming TV video synchronously as it comes in, and 
the secondary port reads the TV video out synchro- 
nously with the high resolution graphics monitor. A 
high resolution frame buffer in a computer is utilized 
to store high resolution graphics which is read out 
synchronously with the high resolution graphics 
monitor. A switching mechanism selects which of the 
TV video and the high resolution graphics video is to 
be displayed at a given time. The TV frame buffer 
includes an on screen and off screen portion. The 
computer provides computer data, including high 
resolution graphics data and audio data to the TV 
frame buffer, with the graphics data being stored in 
the on screen portion and the audio data being 
stored in the off screen portion. The audio data is 
read out to an audio circuit for replay. The graphics 
data is combined with the TV video for purposes of 
windowing. 
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